The contribution of the luminance and opponent chromatic post-receptoral mechanisms to visual working memory

Visual Working Memory (visual WM) is an ability to encode and temporarily maintain visual information. There is some evidence that early perceptual processes make an important contribution to successful WM performance. However, perceptual contributions to WM are not yet fully understood. In vision, signals originating from three classes of photoreceptors in the retina (L, M and S-cones) are combined into three distinct mechanisms, which form the fundamentals of visual perception. These mechanisms are the two opponent chromatic mechanisms (L – M and S – (L + M) and an achromatic, luminance mechanism (L + M). Vision science has been long concerned with properties of these mechanisms and how they contribute to the perception of the world. Despite this, there was little interest to date in how these mechanisms contribute to creating memory representations, i.e. after the visual stimulus has disappeared from the visual field. In a series of experiments presented in this thesis, a differential contribution of three post-receptoral mechanisms to visual WM was investigated. It was hypothesised that luminance signals will prove to be more efficient in their contribution to WM encoding, maintenance and retrieval than opponent chromatic signals. This was investigated using a variety of methodologies, from psychophysical measurements and behavioural responses to recordings of neural activity using electroencephalography (EEG). Results of the experiments have shown that indeed, remembering abstract shapes designed to excite the luminance mechanism contributed to better WM performance comparing to remembering shapes designed to excite the opponent chromatic mechanisms. EEG recordings have shown that this luminance benefit starts already during WM encoding, although later WM stages are likely to benefit as well. The findings demonstrate that luminance signals provide an advantage over opponent chromatic mechanisms in working memory processing

Low-level and high-level modulations of fixational saccades and high frequency oscillatory brain activity in a visual object classification task

Until recently induced gamma-band activity (GBA) was considered a neural marker of cortical object representation. However, induced GBA in the electroencephalogram (EEG) is susceptible to artifacts caused by miniature fixational saccades. Recent studies have demonstrated that fixational saccades also reflect high-level representational processes. Do high-level as opposed to low-level factors influence fixational saccades? What is the effect of these factors on artifact-free GBA? To investigate this, we conducted separate eye tracking and EEG experiments using identical designs. Participants classified line drawings as objects or non-objects. To introduce low-level differences, contours were defined along different directions in cardinal color space: S-cone-isolating, intermediate isoluminant, or a full-color stimulus, the latter containing an additional achromatic component. Prior to the classification task, object discrimination thresholds were measured and stimuli were scaled to matching suprathreshold levels for each participant. In both experiments, behavioral performance was best for full-color stimuli and worst for S-cone isolating stimuli. Saccade rates 200–700 ms after stimulus onset were modulated independently by low and high-level factors, being higher for full-color stimuli than for S-cone isolating stimuli and higher for objects. Low-amplitude evoked GBA and total GBA were observed in very few conditions, showing that paradigms with isoluminant stimuli may not be ideal for eliciting such responses. We conclude that cortical loops involved in the processing of objects are preferentially excited by stimuli that contain achromatic information. Their activation can lead to relatively early exploratory eye movements even for foveally-presented stimuli

The neural basis of authenticity recognition in laughter and crying

Deciding whether others’ emotions are genuine is essential for successful communication and social relationships. While previous fMRI studies suggested that differentiation between authentic and acted emotional expressions involves higher-order brain areas, the time course of authenticity discrimination is still unknown. To address this gap, we tested the impact of authenticity discrimination on event-related potentials (ERPs) related to emotion, motivational salience, and higher-order cognitive processing (N100, P200 and late positive complex, the LPC), using vocalised non-verbal expressions of sadness (crying) and happiness (laughter) in a 32-participant, within-subject study. Using a repeated measures 2-factor (authenticity, emotion) ANOVA, we show that N100’s amplitude was larger in response to authentic than acted vocalisations, particularly in cries, while P200’s was larger in response to acted vocalisations, particularly in laughs. We suggest these results point to two different mechanisms: (1) a larger N100 in response to authentic vocalisations is consistent with its link to emotional content and arousal (putatively larger amplitude for genuine emotional expressions); (2) a larger P200 in response to acted ones is in line with evidence relating it to motivational salience (putatively larger for ambiguous emotional expressions). Complementarily, a significant main effect of emotion was found on P200 and LPC amplitudes, in that the two were larger for laughs than cries, regardless of authenticity. Overall, we provide the first electroencephalographic examination of authenticity discrimination and propose that authenticity processing of others’ vocalisations is initiated early, along that of their emotional content or category, attesting for its evolutionary relevance for trust and bond formation.info:eu-repo/semantics/publishedVersio

Luminance Contrast Drives Interactions between Perception and Working Memory

Visual working memory (WM) enables the use of past sensory experience in guiding behavior. Yet, laboratory tasks commonly evaluate WM in a way that separates it from its sensory bottleneck. To understand how perception interacts with visual memory, we used a delayed shape recognition task to probe how WM may differ for stimuli that bias processing toward different visual pathways. Luminance compared with chromatic signals are more efficient in driving the processing of shapes and may thus also lead to better WM encoding, maintenance, and memory recognition. To evaluate this prediction, we conducted two experiments. In the first psychophysical experiment, we measured contrast thresholds for different WM loads. Luminance contrast was encoded into WM more efficiently than chromatic contrast, even when both sets of stimuli were equated for discriminability. In the second experiment, which also equated stimuli for discriminability, early sensory responses in the EEG that are specific to luminance pathways were modulated by WM load and thus likely reflect the neural substrate of the increased efficiency. Our results cannot be accounted for by simple saliency differences between luminance and color. Rather, they provide evidence for a direct connection between low-level perceptual mechanisms and WM by showing a crucial role of luminance for forming WM representations of shape

Induced Gamma-Band Activity and Fixational Eye Movements are Differentially Influenced by Low-and High-Level Factors in a Visual Object Classification Task

Until recently induced high frequency oscillatory activity (gamma-band activity; >30 Hz) was considered a neural marker of cortical object representation. However, Yuval-Greenberg et al (2008; Neuron) demonstrated that induced gamma-band activity (GBA) in the elecetroencephalogram (EEG) is susceptible to artifacts caused by miniature eye movements, which account for the major part of the signal in the crucial time window of 200-400 ms after stimulus onset. Is there an underlying cortical-induced gamma-band response that is obscured by ocular artifacts but can still be recorded with EEG? Furthermore, if object-specific modulations of induced GBA in previous studies were caused by ocular artifacts, should we instead study fixational eye movements as a response that can reflect higher-level representational processes in vision? In order to investigate this, we conducted an eye tracking experiment and an EEG experiment using the same design. Participants were asked to classify line drawings of objects or non-objects. To introduce low-level differences, their contours were defined along different directions in cardinal colour space: 1) S-cone-isolating (S), or 2) intermediate isoluminant (S and L-M), or 3) a full-colour stimulus, containing an additional achromatic component (S; L-M; L+M+S). In both experiments, behavioural performance was optimal for full-colour stimuli. In the eye tracking experiment, fixational eye movement rates 200-400 ms after stimulus onset depended on low-level factors, with no difference between objects and non-objects. In the EEG experiment, miniature eye movements were identified and removed using the saccadic filter approach. The artifact-free induced GBA exhibited a lateralised distribution, with enhancements at left and right posterior sites. Activity was higher for full-colour objects on the left, with the opposite effect observed on the right. We conclude that induced GBA can be observed in the EEG. While it showed high-level object-specific modulations, miniature eye movements were driven solely by low-level information

Low-level and high-level modulations of fixational saccades and high frequency oscillatory brain activity in a visual object classification task

Until recently induced gamma-band activity (GBA) was considered a neural marker of cortical object representation. However, induced GBA in the electroencephalogram (EEG) is susceptible to artifacts caused by miniature fixational saccades. Recent studies have demonstrated that fixational saccades also reflect high-level representational processes. Do high-level as opposed to low-level factors influence fixational saccades? What is the effect of these factors on artifact-free GBA? To investigate this, we conducted separate eye tracking and EEG experiments using identical designs. Participants classified line drawings as objects or non-objects. To introduce low-level differences, contours were defined along different directions in cardinal color space: S-cone-isolating, intermediate isoluminant, or a full-color stimulus, the latter containing an additional achromatic component. Prior to the classification task, object discrimination thresholds were measured and stimuli were scaled to matching suprathreshold levels for each participant. In both experiments, behavioral performance was best for full-color stimuli and worst for S-cone isolating stimuli. Saccade rates 200–700 ms after stimulus onset were modulated independently by low and high-level factors, being higher for full-color stimuli than for S-cone isolating stimuli and higher for objects. Low-amplitude evoked GBA and total GBA were observed in very few conditions, showing that paradigms with isoluminant stimuli may not be ideal for eliciting such responses. We conclude that cortical loops involved in the processing of objects are preferentially excited by stimuli that contain achromatic information. Their activation can lead to relatively early exploratory eye movements even for foveally-presented stimuli

Low-level and high-level modulations of fixational saccades and high frequency oscillatory brain activity in a visual object classification task

Until recently induced gamma-band activity (GBA) was considered a neural marker of cortical object representation. However, induced GBA in the electroencephalogram (EEG) is susceptible to artifacts caused by miniature fixational saccades. Recent studies have demonstrated that fixational saccades also reflect high-level representational processes. Do high-level as opposed to low-level factors influence fixational saccades? What is the effect of these factors on artifact-free GBA? To investigate this, we conducted separate eye tracking and EEG experiments using identical designs. Participants classified line drawings as objects or non-objects. To introduce low-level differences, contours were defined along different directions in cardinal color space: S-cone-isolating, intermediate isoluminant, or a full-color stimulus, the latter containing an additional achromatic component. Prior to the classification task, object discrimination thresholds were measured and stimuli were scaled to matching suprathreshold levels for each participant. In both experiments, behavioral performance was best for full-color stimuli and worst for S-cone isolating stimuli. Saccade rates 200–700 ms after stimulus onset were modulated independently by low and high-level factors, being higher for full-color stimuli than for S-cone isolating stimuli and higher for objects. Low-amplitude evoked GBA and total GBA were observed in very few conditions, showing that paradigms with isoluminant stimuli may not be ideal for eliciting such responses. We conclude that cortical loops involved in the processing of objects are preferentially excited by stimuli that contain achromatic information. Their activation can lead to relatively early exploratory eye movements even for foveally-presented stimuli

Modulation of microsaccades by spatial frequency during object categorization.

The organization of visual processing into a coarse-to-fine information processing based on the spatial frequency properties of the input forms an important facet of the object recognition process. During visual object categorization tasks, microsaccades occur frequently. One potential functional role of these eye movements is to resolve high spatial frequency information. To assess this hypothesis, we examined the rate, amplitude and speed of microsaccades in an object categorization task in which participants viewed object and non-object images and classified them as showing either natural objects, man-made objects or non-objects. Images were presented unfiltered (broadband; BB) or filtered to contain only low (LSF) or high spatial frequency (HSF) information. This allowed us to examine whether microsaccades were modulated independently by the presence of a high-level feature – the presence of an object – and by low-level stimulus characteristics – spatial frequency. We found a bimodal distribution of saccades based on their amplitude, with a split between smaller and larger microsaccades at 0.4° of visual angle. The rate of larger saccades (⩾0.4°) was higher for objects than non-objects, and higher for objects with high spatial frequency content (HSF and BB objects) than for LSF objects. No effects were observed for smaller microsaccades (<0.4°). This is consistent with a role for larger microsaccades in resolving HSF information for object identification, and previous evidence that more microsaccades are directed towards informative image regions